A Multimodal Result Ontology for Integrated Semantic Web Dialogue Applications

General purpose ontologies and domain ontologies make up the infrastructure of the Semantic Web, which allow for accurate data representations with relations, and data inferences. In our approach to multimodal dialogue systems providing question answering functionality (SMARTWEB), the ontological infrastructure is essential. We aim at an integrated approach in which all knowledge-aware system modules are based on interoperating ontologies in a common data model. The discourse ontology is meant to provide the necessary dialogueand HCI concepts. We present the ontological syntactic structure of multimodal question answering results as part of this discourse ontology which extends the W3C EMMA annotation framework and uses MPEG-7 annotations. In addition, we describe an extension to ontological result structures where automatic and context-based sorting mechanisms can be naturally incorporated.